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Abstract. When analysing time series an important issue is to decide whether the time 
series is stationary or a random walk. Relaxing these notions, we consider the problem to 
decide in favor of the /(O)- or /(l)-property. Fixed-sample statistical tests for that problem 
are well studied in the literature. In this paper we provide first results for the problem to 
monitor sequentially a time series. Our stopping times are based on a sequential version 
of a kernel-weighted variance-ratio statistic. The asymptotic distributions are established 
for /(I) processes, a rich class of stationary processes, possibly affected by local nonpara- 
metric alternatives, and the local-to-unity model. Further, we consider the two interesting 
change-point models where the time series changes its behaviour after a certain fraction 
of the observations and derive the associated limiting laws. Our Monte-Carlo studies show 
that the proposed detection procedures have high power when interpreted as a hypothesis 
test, and that the decision can often be made very early. 
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Introduction 



For many time series, in particular for economic data, the question whether the series is 
stationary or becomes stationary when taking first order differences is a dehcate prob- 
lem. Fixed-sample tests have been extensively studied in the statistics and econometrics 
literature and this topic is still an active area of research. Most proposed unit root tests 
are parametric approaches based on the least squares estimator in an AR model. Under 
the random walk hypothesis non-standard limiting distributions appear. Classic and more 
recent references are Dickey and Fuller (1979), Rao (1978, 1980), Evans and Savin (1981), 
Chan and Wei (1987, 1988), and PhiUips and Perron (1988), Stock (1994a), Saikkonen 
and Liitkepohl (2003), and Lanne and Saikkonen (2003). Nonparametric tests have been 
studied by Kwiatkowski et al. (1992), Bierens (1997), Breitung (2002), and Giraitis et al. 
(2003). The KPSS test, proposed in the first paper and also studied in detail in the lat- 
ter two articles, avoids a detailed specification of the process. It can be easily used for 
testing both the null hypothesis of stationarity against the unit root alternative, and vice 
versa, and, as shown by simulations, is considerably more robust in terms of type I error 
than most parametrically motivated tests. Thus wc use that statistic as a starting point 
to develop detection procedures which can be used to detect a change from /(O) (covering 
stationarity) to /(I) (covering random walks), and vice versa. Similar detection procedures 
related to the Dickey-Fuller statistic, which is often more powerful but can be affected by 
severe size distortion, will be studied by the author in a separate paper in detail (Steland, 



As an example of a simple change-point model (regime switching model) capturing this 
feature consider 



with mean-zero error terms {e„} and a change-point parameter i? G (0, 1). Until the change 
the in-control model of a 7(1) process holds. This model is a special case of a /(l)-to- 
7(0) change-point model studied in this article. If 0„ = e [— 1, 1] Lai and Siegmund 
(1983) studied fixed accuracy estimation of an AR parameter assuming i.i.d. error terms 
by sampling until the Fisher information exceeds a constant. Allowing for dependent errors, 
we consider a different setup and study truncated stopping times of the type — min{l < 
n < N : Tjsf^n < c} for some control statistic, Tn^u, and a control limit (critical value) c, 
where monitoring stops latest at the iVth observation. That maximum sample size, N, 
plays the role of a time horizon where a decision is made in any case; if no signal is given. 



2006). 
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the in-control model (null hypothesis) is accepted as a plausible model, otherwise one stops 
concluding that a change occurred and further measures may be in order. We stop latest at 
N, since often the assumption implicit to many classic monitoring procedures with random 
sample size, namely that a process can and should be monitored forever, is unrealistic, and 
approaches allowing to specify a time horizon may be more appropriate in many cases. For 
example, consider financial portfolios. Continuous or pseudo-continuous (daily) trading is 
often not feasible, due to cost constraints and because identification of mid- and long-term 
investment chances requires time- and cost-intensive analyses on a quarterly to yearly 
basis. Between these analyses one should apply monitoring rules with time horizon to 
trigger additional updates, risk hedges, or other measures. Having approximations to the 
distributions of the control statistic and the monitoring rule (stopping time) for large 
are therefore of interest, thus motivating to assume — oo for asymptotic studies. 

To allow the design of procedures satisfying arbitrary constraints, e.g. prespecified type 
I error, average run length (ARL) or median run length, we establish the limiting laws 
which are functionals of Brownian motion or the Ornstein-Uhlcnbcck process. Besides 
the important change-point models mentioned above, we consider pure random walks, 
stationary processes, local trend-stationary processes, and the local-to-unity model, where 
a sequence of models is considered which converges to a random walk, as the maximum 
sample size, N, tends to oo. 

Let us briefly comment on other related work. The nonparametric detection of a change in 
the mean of a stationary time series based on kernel- weighted averages and the problem of 
optimal kernel choice has been studied by Steland (2004a, 2005a). For the related problem 
to detect a change in the mean of a random walk see Steland (2005b). A posteriori methods, 
where observations after the change are also available, have been studied by Ferger (1993, 
1995), Huskova (1999) and Huskova and Slaby (2001). For an approach based on jump- 
preserving statistics aiming at detecting quickly large shifts see Pawlak, Rafajlowicz and 
Steland (2004) and Steland (2005c). The problem to detect changes in a linear model has 
been recently studied by Horvath et al. (2004) using CUSUMs of residuals. 

Retrospective change-point detection allowing for time series data has been studied quite 
extensively by many authors. Kramer and Ploberger (1992) study partial sums of OLS 
regression residuals to detect structural changes. Bai (1994) estabhshed weak convergence 
of the sequential empirical process of ARMA(p, g)-residuals and constructed a CUSUM- 
type statistic to detect a change in the distribution of the innovations. Noting that, e.g., 
ML estimates usually can be written as arithmetic means of stationary martingale dif- 
ferences, Lee et al. (2003) studied a CUSUM procedure to detect changes in parametric 

3 



time series models. For work on structural breaks and changes in the trend function in 
integrated variables, we refer to Nyblom (1989), Perron (1991), Vogelsang (1997), Hansen 
and Johansen (1997), and Bai, Lumsdaine and Stock (1998). For further references to the 
extensive literature about these issues we refer to the references given in these papers. 

The paper is organised as follows. In Section [T] we explain the proposed monitoring pro- 
cedure and basic assumptions. Functional central limit theorems (FCLTs) under general 
conditions are given in Section [2j Change-point problems for a change from /(O) to /(I), 
and vice versa, are discussed in Section [31 Section H] provides Monte Carlo results to assess 
the accuracy and performance of the considered stopping times demonstrating that the 
procedure works very reliable and often can detect stationarity earlier than a fixed sample 
test, and that using a weighting scheme improves the detection of a change-point. 

1. Preliminaries, method, and assumptions 

We will use the following nonparametric definitions of the notions /(O) and /(I). A time 
series {Yn} is called /(O), denoted by F„ ~ -^(0), if 

lNs\ 

N-'l'Y.^,^aB{s), se[0,l], (1) 

i=l 

holds for some constant < cr < oo. Here and throughout the paper [xj denotes the floor 
function, i?(s), s G [0, 1], denotes Brownian motion, and ^ stands for weak convergence 
in the space -D[0, 1] of all right-continuous functions with left-hand limits equipped with 
the Skorohod topology given by the Skorohod metric d. For that approach to weak conver- 
gence we refer to Billingsley (1968) and Prigent (2003). In terms of mixing and moment 
conditions, a sufficient condition for ([T]) is, e.g., that {Yn} is a stationary a-mixing se- 
quence with i^lFip^'^ < oo and '^(^)^''''^^'^^ < °° ^"^^ some 5 > where a{k) are the 
mixing coefficients (e.g. Herrndorf (1985)). Some of our limit theorems assume ([T]) under 
additional weak regularity conditions. We will formulate these conditions where needed. 

{Yn} is integrated of order 1, denoted by Yn ~ /(I), if 

N-^'^YyNs\^(yB{s), sG[0,l], (2) 

as — )■ oo, and the differences, AF^ = Yn — Yn-i-, form a /(O) series. Note that our 
definition of /(O) does not necessarily implies stationarity and allows for a certain degree 
of dependence. The /(I) property is also quite general, covering classic random walks 
Yn = X]r=i ^« with mean-zero i.i.d. innovations {ut}, but, e.g., also allows for random 
walks with dependent innovations Ut satisfying a functional central limit theorem of the 
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type ([T]). However, long memory processes in the sense that ^^.^^ |Cov (Yi, = oo 

are not allowed. 

In the literature the /(O) property often means that the time series is a linear process, 
X]jlo'^i^*-i' where {Z^} is a weak white noise sequence and the parameter sequence {ipj} 
is absolutely summable with Ylj V'i 7^ 0- However, our definitions have been used by many 
other researchers, e.g.. Stock (1994b), and are appropriate to describe the classes of time 
series which can be distinguished by the methods studied in this paper. 

Let us now assume that the time series observations Yi, . . . , Y^, N & N, arrive sequentially 
at ordered time points ti, . . . ,1^. To simplify presentation we assume t„ = n G N, but 
more general time designs can be handled as in Steland (2005b). It is known that a robust 
nonparametric unit root test is given by considering the ratio of the dispersion of the 
cumulated observations and the dispersion of the observations, cf. Kwiatkowski et al. (1992) 
or Breitung (2002). Having in mind change-point models where the time series changes its 
/(O) respectively /(I) property at some unknown time point, we introduce appropriate 
kernel weights to avoid that past observations dominate the statistic. We first introduce 
a sequential kernel-weighted variance-ratio process which is appropriate to detect /(O) 
processes, and will then describe a modification to detect /(I). Defin^ Un{s) = for 
s G [0, 1/A^) and 

f/iv(s) = r^. , s G [1/N, 1]. (3) 

Kh{-) = K{-/h)/h, where is a Lipschitz continuous density function with mean and 
finite variance, and h = > is a. sequence of bandwidth parameters satisfying 

N/h^^C^^ [l,oo), 

as — 7- oo. The definition of the kernel weights, Kh{i — L^-^J)' requires only a kernel 
function K defined on (— oo, 0]. Thus, we can and will assume that K is symmetric around 
0, otherwise put K{z) = K{—z), z > 0, if i^" is only defined for 2; < 0. Clearly, depends 
on the bandwidth parameter h. If K has support [—1, 1], [/at is a function of the current 
and the most recent h observations. However, our results allow for kernels with unbounded 
support, e.g., the Gaussian kernel. To apply the procedure, one chooses the time horizon N 



^ In a previous version of this paper we scaled numerator and denominator by powers of N^^ instead of 
\_Ns\ ^. Simulations indicate that both version have very similar power properties. Scaling with [Ns\ ^ 
has the advantage that the values of the process needed to calculate the stopping time do not depend on 
the maximum sample size N, but requires to put Un{s) = for s e [0, ^/N). 
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and the bandwidth h, puts ( — N/h, and uses the asymptotic distributional results given 
in the subsequent sections as approximations. 

Although technically not required, one usually employs kernels K{z) which are decreasing 
in \z\ and satisfy lim|2|_^oo ^{^) — 0, to ensure that past partial sums have smaller weights 
than more recent ones. The technical role of the denominator is to estimate a nuisance 
parameter summarising the influence of the dependence structure of the time series on the 
asymptotic distribution of the numerator of C/jv if {^} is 

If is /(O), the numerator of C/jv has a different convergence rate, and one should also 
modify the denominator of U^. Following Kwiatkowski et al. (1992) and others, let 

[Ns\ / i Y I 

u^{s) = (^E^^j ^'^(^ - L^^J) ' e [0, 1], (4) 

where 

i=\ fc=l 4=1 

is the process version of the Newey-West HAC estimator. w{k,m) is a weighting function. 
One may use the Bartlett window, w{k, m) = 1 — A;/m, as in Newey and West (1987) which 
guarantees nonnegativity of s^m(s). For consistency the rate m = o{N^^'^) suffices under 
general conditions, see Andrews (1991) where also various choices of the weighting function 
arc discussed. As shown in Giraitis et al. (2003), for Bartlett weights the rate m = o{N) 
suffices under certain conditions. 

Sequential /(O) detection: Assume the time series is /(I) before the change-point and /(O) 
after the change. Noting that large values of Un{s) provide evidence for the unit root 
hypothesis whereas small values indicate /(O), wc propose the stopping time 

Rn = -Rjv(c) = min{A; < n < N : UN{n/N) < c}, 

with the convention min — N, for some critical value (control limit) c. k denotes the start 
of monitoring. As supported by our simulations, one should choose k > 1 sufficiently large 
to avoid that the procedure starts with only a few observations. Thus, it is reasonable to 
assume that 

k = [kN\ , for some k e (0, 1), (5) 

although some of our theoretical results do not require that condition. The related fixed- 
sample test rejects the null hypothesis Hq that {Yn} is a /(I) process in favour of the 
alternative Ha that the time series is /(O) if Rn < N. The associated type I error rate 

is Po{Rn < N), where Pq indicates that the probability is calculated assuming Hq, i.e., 
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Yn ~ /(I)- We propose to select c as follows. First fix size a G (0, 1). Then choose c such 
that the associated fixed-sample test has type I error rate a, i.e., Po{Rn < N) = a. Our 
asymptotic results can be used to obtain large sample approximations for c. 

Noting that many classes of stationary time series considered in practice satisfy the J(0) 
property ([T]), the proposed detection rule can be used to detect stationarity, if the appli- 
cation suggests to consider the class of stationary /(O) time series. 

Sequential /(I) (unit root) dection: Assume the time series starts as a (subset of a) station- 
ary /(O) process which ensures that the Newey-West estimator is consistent (for conditions 
see Theorem 12.21 (ii)). and changes its behavior to a /(I) process at a change-point (struc- 
tural break). To detect the change one may use the stopping time 

= Rn{c) = mm{k < n < N : Uiyin/N) > c} 

for some critical value c. The associated fixed-sample test rejects the null hypothesis Hq : 
/(O)-stationarity in favour of Ha : /(l)-unit root, if Rn < N. Again, one may choose the 
control limit c to ensure that the type I error Po{Rn < N) attains a nominal value a. Note 
that now Pq indicates that the probability has to be calculated assuming that ~ -^(0). 



2. Asymptotic results for /(O) and /(I) processes 

In this section we provide the asymptotic distribution theory of the processes Un and Un 
and the related stopping times Rn and -Rat by establishing FCLTs under various basic 
distributional assumptions of interest. Particularly, these results can be used to obtain 
approximate critical values by simulating from the limiting law and also justify to simulate 
the procedures using normally distributed error terms. 

2.1. Asymptotics for /(I) processes. The following result provides the asymptotic dis- 
tribution of Un under the random walk hypothesis that the time series {Yn} is /(I). The 
result in Breitung (2002, Proposition 3, p. 349) is obtained as a special case by letting 
Kh{-) = 1 and s = 1. In general, the asymptotic distribution is a functional of the Brown- 
ian motion, the kernel K, and the parameter ( = limAr^oo N/Hn- 

Theorem 2.1. Assume {Yn} is /(I) in the sense of then 

Cs-' ['K{C{r-s))\[;:B{t)dt? dr 
Jo B{rydr 

in D[k,,1], as N CO with N/h — )■ (. The process Ui has continuous sample paths w.p. 1. 
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Proof. Clearly, we have 

X,j^{s) = [Ns\-^y^Y^ ^ah-^ B{rfdr = X^{s). 

i=i 

Since K is Lipschitz continuous and N/h — )■ a more involved argument using the Skoro- 
hod/Dudley/Wichura theorem shows that 

i=i \j=i / 

can be approximated by a continuous functional of A^'^/^FlatsJ, and therefore 

X27v(s) ^Cs^V^ (^j^ B{t)d?j K{C{r-s))dr = X2{s), 

as — !■ oo. However, to conclude weak convergence of X2n{s)/Xij^{s) we need joint 
weak convergence of the pair {Xin{s), X2n{s)) in the space {D[K,l]y. By the Skoro- 
hod/Dudley/Wichura theorem we may assume that the convergence of Xiiv(s) and X2n{s) 
is in the supnorm. First, note that the finite-dimensional distributions of AiX^v + ^2X2n 
converge to the corresponding finite-dimensional distributions of AiXi + X2X2, as — ?■ 00, 
for any scalars (Ai, A2) G M^. Further, clearly, the sequence {{Xin{s) , X2n{s)) : s E [k, 1]}, 
N > 1, is tight, since both coordinate processes are tight. We obtain joint weak conver- 
gence (XiAT, X2n) =^ {Xi, X2), — )■ 00, as elements of the function space [-D([/t, 1])]^- Now 
we can apply the continuous mapping theorem (CMT) to obtain X2nIXin =^ X2/X1, 
N ^ 00. Since K is Lipschitz continuous and integration is continuous, numerator and de- 
nominator are continuous functions of s, w.p. 1. Hence Ui{s) has continuous sample paths 
w.p. 1. □ 

Remark 2.1. Observe that the theorem can be slightly extended to yield Un{s) =^ Ui{s), as 
N — )■ 00, in D[0, 1], if Ui{s) is defined for s G (0, 1] by the right side of and Wi(0) = 0. 
Nevertheless, in Theorem \2.1\ and also in the sequel, for Uiy{s),Uiy{s), Rn, and we 
consider weak convergence in the space D[k, 1], which suffices for our purposes. 

In practical applications the time series is sometimes first demeaned or detrended. This 
alters the asymptotic distribution as follows. 

Remark 2.2. Suppose the procedure is applied to the residuals instead of the original 
observations. For applications the most important cases are that the sample Yi, . . . , Y/v is 



centered at its mean or detrended. In the former case Yi is replaced by 

N 

e^ = Yi-N'^^Yi, i = l,...,N, ('demeaned'), 



i=l 

whereas in the latter one uses 



ei = Yi — [5q — f3ii, i = 1, . . . , N, ('detrended'), 

where /3o cmd /3i are the OLS estimators from a regression of Yi on the regressors (l,i). 
Then the Brownian motion B in the formula for Ui has to he replaced by the tied-down 
Brownian motion (Brownian bridge) -B'^(s) = B{s) — sB{l) when demeaning and 

B\s) = B{s) - {4:-6s) [ B{r)dr-{l2s~Q) f rB{r)dr, sE [0,1], 

Jo Jo 

when detrending. 

Corollary 2.1. Under the conditions of Theorem \2.1\ 

N-^Rn Amm{K<s <l:Ui{s) <c}, N ^ oo. 



Proof. Note that 



By the CMT 



^Rn > X ^ sup Un{s) > c 



V]^{x) = sup Un{s) =^ sup Ui{s) = V{x), 

sS:[k,x] s£[k,x] 

N oo, which implies that for all a; G M and all continuity points c > of the distribution 
function of V{x) we have 

lim Fn{x) = lim P{N-^Rn < x) = P{ sup Ui{s) < c) = F{x). 

It remains to check whether V{x) may have atoms. Since Ui G C[0, 1] w.p. 1, we may work 
in the separable Banach space (C[0, 1], || ■ ||oo) and can apply Lifshits (1982, Theorem 2) 
which asserts that the distribution of V{x) can have an atom only at the point 

7x= sup E(Wi(t))=0, 

0<t<x: VarWi(t)=0 

equals on (—00,72:), and is absolutely continuous with respect to Lebesgue measure on 
[7a;, 00). Hence all c > are continuity points of V{x). □ 
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2.2. Asymptotics for /(O) processes. For weakly stationary /(O) time series {Yn} sat- 
isfying a certain condition on the fourth-order moments, the variance-ratio process t/iv(s) 
still has a non-degenerate limiting distribution if scaled with A^. However, the limit de- 
pends on a nuisance parameter summarizing the dependence structure. We consider both 
mean-zero /(O) processes and /(O) processes which are disturbed by a local deterministic 
alternative. 

For the process Un{s) using a Newey-West type estimator to eliminate the nuisance pa- 
rameter from the limit distribution, we use a weak mixing condition. 

The first result considers stationary /(O) processes. The limit given in Kwiatkowski et al. 
(1992, formula 14) is obtained as a special case if Kh{-) = 1, C = 1; aiid s = 1. 

Theorem 2.2. (i) Assume {Yn} is a weakly stationary mean zero /(O) process such 
that {Y^} is weakly stationary, 

72(fc) = E{Y,%1,) ^ 0, \k\ ^ oo. (7) 

Then 

INs\Un{s)^U2{s) = ^s-\ B{rfK{ar-s))dr, 

in D[n^V\, as N ^ oo. The process U2 has continuous sample paths w.p. 1. 
(ii) Assume {Yn} is a strictly stationary a-mixing /(O) process such that EY^" < 00 
and 

00 

J^MjY'-'^^" < 00, (8) 

for some u > 1. Then, ifm/N^^"^ = o(l), 



Un{s) U2{s) = s-\ I B{ryK{C{r - s)) dr, 
in D[k, 1], as N ^ 00. 
Proof. By assumption A^-^s ^L^^^J y. ^ aB{s), as ^ 00, where = ^(^1^1 



+k) 



By the weak law of large numbers (Brockwell and Davis (1991), Theorem 7.1.1), ([7]) implies 
that for fixed s G [n, 1] 



lNs\ 

Vr,^{s) = [Nsr'J2'^,'''4'EY,' = V,, 

i=l 
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as — !■ oo, where means that the convergence holds in probabihty and in quadratic 
mean, i.e., in the L2-space. The hmit is a.s. constant in s. Further, 

AT ^"^'^ f ' V 



N 

-{N/h) 



j ( ^^^^^ E I L^^J ~ L^^J /^) 



ah-^C [ K{Cir-s))B{rydr = V2{s), 
Jo 



ii N oo. Bilhngsley (1968, Theorem 4.4) now imphes weak convergence of the pair 
(yNi,VN2), and an apphcation of the CMT yields Viy2/Viyi =^ V2/V1 = U2, as — )■ 00. 
Since K is Lipschitz continuous, the process U2 has continuous sample paths w.p. 1. To show 
(ii) the proof is modified as follows. By Andrews (1991, Lemma 1) the mixing condition 
ensures his Assumption A. Hence, if m/N^/'^ = o(l), s^^(s) A scr^, as A^ — 00, which 
implies weak convergence to the non-stochastic function so"^, s G [k, 1]. □ 



Remark 2.3. Statement (i) implies that the Un statistic is consistent against stationary 
alternatives. 

Remark 2.4. Consistency of sj^^ for Bartlett weights has also been shown under the 
weaker condition m/N = o(l) provided that J2j < 00, 7^- = Cov(Yi,Yi^j), and 

00 



sup |/t(/i, r, s)| < 00 



h 

r,s=— 00 



where 

K{h, r, S) = E[{Yk - fl)iYk+h - /U)(>fc+r - At)(^fc+. - 1^)] - (ihlr-s + Irlh-s + Islh-s) 

is the fourth order cumulant (Giraitis et al. (2003), Theorem 3.1.). This condition holds, 
e.g., for linear processes with absolutely summable coefficients. 

Remark 2.5. In case that the time series is demeaned or detrended first, again the Brown- 
ian motion in the representation 0/W2 has to be replaced by the tied-down Brownian motion 
5^ or the process 5*. 



Again, we have the following corollary for the related stopping time. 
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Corollary 2.2. Under the conditions of Theorem \2.2\ we have 

N-^Rn a mm{K < s < 1 : ^2(3) > c}, N ^ 00. 

So far we considered mean-zero time series. The following theorem provides sufficient con- 
ditions for a well-defined limit for a /(O) series with a (local) nonparametric trend. 

Theorem 2.3. Suppose {Yn} satisfies Yn = rrin + Un,n G N, /i > 0, where satisfies 
the conditions of Theorem\KE (i) with the Yn replaced by Un's, and {mi^^n} is an array of 
non-negative constants with mj^^n < M for all N, n, such that 

(i) ^JA^^'J Ui crB{s), as N ^ 00, for some < a < 00, 

(ii) supo<,<i |iV-i/2 J2\=!^ rnM,i - fi{s)\ ^0, as N-^ 00. 

for some deterministic drift fi{s) G D[0, 1], which is continuous at 0. Then 

[Ns\ Un{s) U^{s) = ^T^C flKr) + aBir)]'K{C{r - s)) dr, tn D[k, 1], 

as N ^ 00. If ^ & C[0, 1], then U2 has continuous sample paths w.p. 1. 

Proof. Using Jacod and Shiryaev (2003, VI, Proposition 1.22, p. 329) conditions (i) and (ii) 
yield N""^/"^ ^ f^i-^) +o'B{s), in D[0, 1], as — > 00. The proof follows by a simple 

modification of the proof of the previous theorem by noting that for the denominator we 
have 

[Ns] [Ns] lNs\ [Ns] 

[Ns\ J2 = iN'i E + 2 iNs} "^^.^"^ + L^^J E 

i=l i=l 1=1 i=l 

4 EY,\ 

as — 00, because m^^i < M for all i and for some constant M > implies 
< M/N^' E^im^./N'/') = 0(1). □ 

We illustrate the conditions (i) and (ii) by a local change-point model, where starting at 
a change-point lN'd\ the mean is no longer but positive and induced by a non-negative 
function ttlq : M — )■ Particularly, (truncated) linear trends as mo(x) = ax if x G [0, 1] 
and mo{x) = otherwise for some a > are allowed. 

Example 2.1. Assume Yjsf^n = ^N,n + with 

mN,n = moiin - [m\)/N)N-^/\ 

Here we assume that the function mo : M — )■ M satisfies m{s) = for s < 0, is right- 
continuous, non-negative with bounded variation, and has at most finitely many jumps. 
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Further, mo is assumed to be Lipschitz continuous and bounded between the jumps, and 
is integrable, i.e., mo(t) dt < oo. Finally, we assume that there is some t* > with 
mQ{t) > for t G (0,t*). It is easy to see that the conditions (i) and (ii) of Theorem \2.3\ 
are satisfied. The limiting mean function is given by 



n{s) = / mo{r — dr, 
Jo 

and one obtains 

N-^^^ y^'^NA ^ / rnoir-^)dr + aB{s), 
Jo 



i=l 

as N ^ OO. 

Remark 2.6. By making use of the Karhunen-Loeve representation 

n=0 ^ ' ' 

where {Zn} are i.i.d. N{0, l)-random variables, cf. Ito and Nisio (1968), we also represented 
the limiting distributions as simple rational functions of infinite quadratic forms of the type 

oo 
n,m=0 

Following a referee, we omit these results here, since we did not use them for our simula- 
tions. 

2.3. Asymptotics for local-to-unity processes. Let us now consider tlie asymptotic 
behaviour of Un under a model which is nearly /(I). More precisely, we consider a sequence 
of models which converges to an J(l) model yielding what is called local-to-unity asymp- 
totics. The local-to-unity model assumes that we are given an array {Yj^^n : iV G N, n G N} 
satisfying 

YN,n+i = (1 + a/N)YN^n + Un, l<n<N,NeN, (9) 
where a G M and {«„} is a J(0) process. Thus, {Yj^^n} converges to a random walk, 
as —7- oo. Note that both positive and negative values for a are allowed. Under the 
local-to-unity model an Ornstein-Uhlenbeck process appears in the limit process instead 
of the Brownian motion. It has been proposed in the literature to use estimates for a and 
to use the corresponding asymptotic distributions under the local-to-unity asymptotics as 
approximations. The analyses of Stock and Watson (1998, Table 7) for the US annual series 
of the GDP, consumption, and investment imply estimates for a in the region between —15 
and —3. 
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The following theorem contains Breitung (2002, Proposition 4, p. 350) as a special case. 



Theorem 2.4. Assume the local-to-unity model ^ holds. Then 

Cs-^i:[Io2{t-a)dtYK{as-r))dr, 
Jq Z[r; ay dr 

in D[n, 1], as N ^ oo, where 

Z{s;a) = [ e"(^-^)rf5(r), s G [0,1], 
Jo 

is an Ornstein-Uhlenbeck process. Further, 

N~^Rn a min{/t < s < 1 : Uz{s) < c}, ^ oo. 

Remark 2.7. The stochastic integral appearing here is of the type I{s) = F{s, r) B[dr), 
F{s, r) non-stochastic, strictly monotone in r and bounded with bounded variation. It is a 
special case of the Ito integral. However, since the Stieltjes integral B{r) F{s, dr) exists, 
I{s) can also be defined by the integration by parts formula 

/ B{r)F{s,dr) = F{s,r)B{r)YZl- F{s,r-) B{dr), 
Jo Jo 

where F{s,r—) = limx^j. ^ {s , r) . For this approach see Shorack and Wellner (1986, p. 127) 
or Gill (1989, p. 110). 

Proof. Put Wn = Er=i neN, and ^jv(s) = N''^/^ ^21=1^ s G [0, 1]. By assumption 
Sn{s) =^ aB(s) in D[0, 1], as — )■ oo. We may assume a = 1. Note that N~^^'^Yn,[ns] can 
be written as a stochastic Stieltjes integral, namely 



1=1 



J](l + a/iV)L^^J-W-i/2(iy,-iy,.i) = r er,{r;s)dSN{r), 
i=i Jo 



where the integrand, e7v(r; s) = (1 + a/A^) L^^J-L^'-J , (r, s) G X = {{u,v) G [0,1]^ : < 
M<'j;,0<'j;<l}, isa step function in r. The fact that log[(l + a/iV) L^'J " L^^'^J /e^^""'^)] = 
a(s — r) + o(l) uniformly in (r, s) G X implies that eAr(r; s) converges uniformly in (r, s) G X 
to e(r; s) = e"'^'^~'^\ Particularly, there is some constant C such that |eAr(r; s)\ < C for all 
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(r, s) e I. Further, since for a < and fixed s e [0, 1], the variation J |(iejv(-; s) \ of ejv(r; s) 
as a function of r e [0, s] is given by 



\deN{-;s) 



lNs\-l 

{eN[{t + l)/N-s]-eN{t/N-s)} 



i=0 



(1 + a/Ar)LJV.J-LJVr-j _ (1 ^ a/A^)L^^J ^ e"(^-^) - e»^ 



sup 

SG[0,1] 



It follows that sup5g[o^i] J \deN{-; s)\ < oo. To estimate 

Jo Jo 
we use the decomposition 

ps ps rs ps 

/ eN{r;s)dSN{r)- e{r; s) dB{r) ^ / [eN{r; s)-e{r; s)]dB{r)+ eN{r; s) d[Sn{r)-B{r)]. 
Jo Jo Jo Jo 

Of course, 



sup 
se[o,i] 



eN{r; s) dB[r) — / e{r; s) dB[r) 
Jo 



4o, 



as N ^ OO, see, e.g., Shorack and Wellner (1986, p. 130). Integration by parts yields 



sup 
se[o,i] 



eAr(r;s) d[SN{r) - B{r)] 



<2C\\Sn-B\\^ + \\Sn-B\\^ sup / \deN{-,s)\. 

se[o,i] J 



These estimates imply 

Jo Jo 



as N ^ oo. We obtain 



Vmis) 



Ar2 



i=l 

{N-^/^Yi,^yi,,^f dr 



[_Ns\''Jo 

a^s-'^ [ Z{r;a)'^dr^Vi{s 
Jo 



'0 
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in -D[k, 1], as — )■ oo, and, using the same arguments as in the proof of Theorem 12.1 




in 1], as — )■ oo. Noting that V^i and Vn2 are functionals of N~^/'^Yj^^\_j^s\ up to 
neghgible terms, we obtain (Vni, Vn2) =^ (Vi, V2), as — )■ 00. Hence the CMT yields the 
assertion. □ 



3. Change-point models 

The question arises how the sequential processes and stopping times considered above 
behave under a change-point model where after a certain fraction of the data the time 
series changes. In this section we consider both change-point models, a change from /(O) 
to /(I) and a change from /(I) to /(O). To design a monitoring procedure (stopping rule) 
having well-defined properties under the null hypothesis of no change, the results from 
the previous section about the asymptotic distribution of Un{s) (under a /(I) process) 
and [Ns\Un{s) or Un{s) (under a J(0) process) apply. In particular, for the /(0)-to-/(l) 
change-point model monitoring can be based on the stopping time calculated from 
the process Un{s) which has the well-defined limit ^2(5) for /(O) processes, i.e., under the 
null hypothesis of no change. To design a stopping rule for a /(l)-to-J(O) change-point 
model one would rely on the stopping time Rjy and its asymptotic distribution, which is a 
functional of Ui{s), the well-defined limit of Un{s) for /(I) processes. 

We will now study the asymptotic laws under the general case of a change, i.e., under the 
alternative hypothesis that a change-point exists. For both change-point models the inte- 
grated subseries of the time series Yi, . . . , Y/v determines the proper scaling, since in both 
models Un{s) has a well-defined limit, whereas [Ns\Un{s) is degenerated. In this sense, the 
change-point problems are qualitatively different and the situation is not symmetric. The 
/(l)-to-/(0) is smoother in the sense that the same process can be considered to study the 
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behaviour under the no-change hypothesis and the alternative of a change-point, whereas 
for the J(0)-to-/(l) problem the scaling has to be changed. 



3.1. A change from /(O) to /(I). Let us assume that the time series is a mean-zero 
fourth-order /(O) process satisfying condition ([7]) at the beginning, but becomes a random 
walk, i.e., J(l) process, starting at the time point [iV-i^J, where G (0,1). We consider 
the following change-point model. Let {m„ : n > 0} be a mean-zero weakly stationary /(O) 
time series such that all moments of order 4 exists and are stationary, and condition ([7]) is 
satisfied when the Yn are replaced by ti„'s. Further assume that 

' \ Y,-i + u„ 1= [iV^J,...,iV. 

Then, Fi, . . . , I^lat^j-i ~ /(O) and Flat^j, . . . , Y/v ~ IiX)i at the change-point yN'd\ the 
time series changes from stationarity to a /(I) series. 



Lemma 3.1. Under the change-point model uD^i we have 

PS 

N-^/^Yimi dt^a B{t) dt, N ^ oo. 

J minis 'd) 



in ^[0,1]. 
Proof. Define 




NYiNt\ dt, 0<s<^, 
iVyLivtj dt + iV-i/2(y^^^j _ y^^^j), ^ < ^ < 1. 



Then, Wjy G D[0, 1] for each iV G N. By construction of Wn, we have Wn =^ crB, N -)■ 
oo, in D[0, 1], if f lTU]) holds. By the Dudley/Skorohod/Wichura representation theorem in 
general metric spaces, there exists a probability space with equivalent versions Wn and B 
such that d{WN, -B) a.s, for N ^ oo. Since B G C[0, 1], we even have ||iyAr -i?||oo 
a.s., N ^ oo. Thus, we may assume 



sup 

0<s<i? 



f Y^Nti dt - aB{s) 
Jo 



0, N ^ oo, 



and 



sup \N-'/\Y^r^,i - Fl^v^j) - a[B{s) - B{d)]\ "-^ 0, N ^ oo. 

i9<s<l 
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Note that for ^9 < s < 1 we have 

Jo Jo J-d 

which should be close to aB{s)/N + a B(t) dt, whereas for < s < ^9 the second and 
third term vanish. Indeed, if we define the D[0, l]-valued process 



aB{s)/N, 



0< s 



aB{d)/N + (r f^B{t)dt, < s < 1, 
and observe that Ajv(s) =^ A{s; -i?), as — )■ oo, where 



A{s;^) =a B{t)dt, < s < 1, 



we obtain the estimate 



sup 

sG[0,l] 



N-'/^Y^Ntidt-A^{s) 



min(s,i?) 



< A^~^ sup 

s€[0,'d) 



+iV~^ sup 
se[i?,i] 



+ sup 

se[i?,i] 

+ sup 

se[i?,i] 



[ N^I^Y\^Nt\dt- aB{s 
Jo 

/ N^'^YYNt\dt-aB{d) 
Jo 

PS PS 

/ N-'/^Yim\-Yij,^i}dt- aB{t)dt 

J'Q J-d 



as iV oo. Whereas the first three terms are obvious, let us consider the last one. Ac- 
cording to ffTUl) we have 

1714 = E\YiN^^ \^ = E\uiN^^^i + UlN^^ \^ < OO, 



since £"1^1 1^ < oo by assumption. Therefore, 

E I sup \N-'/%N^i{s - 'd)] 
\ se[i?,i] 



< 



E[N-'/'\Y^N^i\{l-^)Y- 

iV2 ■ 



By Markov's inequality we can conclude that for any e > 



sup 

~1 



|iV-/^V.j(. - ^)| > . 1 < £ < oo. 



N=l 



W2 



18 



Now Serfling (1980, Theorem 1.3.4) yields 



sup \N-'/%^^i{s-^) \ n-0, 



as — > oo. The convergence 



sup 

sg[0,l] 



a.s. „ 

0, 



as — )■ oo, imphes convergence in the metric d, which in turn imphes weak convergence 
of the original versions, see e.g. Billingsley (1968, Theorem 4.3) or van der Vaart (1998, 
Theorem 18.10). □ 

Theorem 3.1. Assume the /(0)-to-/(l) change-point model [T^) holds. Then for Un as 
defined in ^ we have 

'0, sG[0,^), 
as N ^ oo, yielding 

min{K < s < 1 : Woi,^(s) > c}, 

as N ^ oo. 



Un(s) =^ Urn As 



01,)9l 



Proof. An easy application of Lemma 13.11 yields for the numerator of Un 



i=l ^7=1 ^ 

N-^/^Yy^Mt\ dt ) K[{YNr\ - [Ns\)/h] 



iV3 N ^ 

|3 







\NsY h 



in D[k,, 1], as A^ — 7- oo. Since for s > 



1 2 



a / 5(t)cit 



K{ar-s))dr, 



-1 



r f2^^j dt ^ s-'a^ flBit) + B{d)f dt, 



as A^ — )■ OO, and, by stationarity of Yi, . . . , I^lat^j-i, A^ ^ X]l=i ^ "SC"^ if s < for the 
denominator of L^tv we obtain 

[Ns\-^ V ^ l(s > i9)s-V2 / [5(t) + 5(79)]2 rft, 
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in -D[k, 1], as — 7- oo. Note that the denominator is positive w.p. 1. Using the arguments 
given in detail in the proof of Theorem 12.11 and applying the CMT yields the assertions. □ 

3.2. A change from J(l) to /(O). Now assume that the first part of the time series is a 
random walk, i.e. /(I), and changes to a /(O) process at the change-point [A^-i^J for some 
fixed constant ^ G (0, 1), i.e., 



Here rj > is a scale parameter, which is briefly discussed at the end of this section, and 
{un} is a weakly stationary mean zero J(0) time series satisfying condition ([7]). 

Model (fTT]) implies that the variance function is linear with positive slope before the change 
and constant after the change. 

Lemma 3.2. Assume the change-point model / fli]) holds. Then we have 



Proof. Noting that N-'^/^Y^mi (rB{t) ii t < ^, N^/'^Yim\ dt w[Bis) - B{^)] if 
< s < 1, and 



if "(9 < s < 1, the lemma is shown analogously to Lemma [3?T| if we define the D[0, l]-valued 
process 




EU^v ^ = o,...,Liv^j -1, 

r]u^, i = [m\ , . . . , AT, 



(11) 





and note that Zn{s) =^ cr 




□ 



Theorem 3.2. Under the /(l)-to-/(0) change-point model 177]) we have 





r 

Jo 



B{tydt 



as N ^ oo, yielding 



N ^Rn a min{K < s < 1 : Wio,i)(s) > c}. 



as N ^ oo. 
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Proof. The theorem is proved using the same approach as in Theorem I3.1[ We indicate the 
differences. First note that by Lemma [3.21 

L^^J / i X 2 



i=i ^j=i ' 



N 

[Ns\^~h Jo \Jo 

PS / /•mm(r,i)) \ ^ 

s-\ B{t)dtj KiCir-s))dr. 



N-'/^Y^m\ dt ) K{{[Nr\ - [Ns\)/h)dr 

min{r,i?) \ 2 



N-^YL^^ dt:Q<s <§ \ ^ la'^ / B{tf dt : < s < ^ 



as — )■ oo. To handle the denominator of observe that 
For s > i) we obtain 

j=l L^^^J \ j=l j=lNi)] J 

yielding i^[N s \-' : . G [0,1]| i^s'^a^ J^^""^'''^ B{tf dt : . G [0,1]|, as 
^ oo □ 

Remark 3.1. Note thatUio^^ does not depend on rj. Hence, the detection procedure given 
by Rn is asymptotically robust w.r.t. changes of the variance. 



4. Simulations 



We perform Monte Carlo simulations to investigate the actual finite sample performances of 
the proposed monitoring procedure. We first consider the statistical properties of the pro- 
cedures, if the time series is either J(0) or /(I). In a second step we study the performance 
under change-point models. All simulations are based on 50,000 repetitions. 

4.1. Models without change-point (either /(O) or /(I)). The first model we use for 
the simulations is as in Stock (1994a), an AR(1) process with MA(1) errors, 

Yo = 0, Yn = (pYn-i + e„ - (3en-i, n = l,...,N, 

where (f) and P are parameters and {e„} i.i.d. A^(0, 1) innovations. The parameter values 
were chosen to be <^ = 1,0.95,0.9,0.7 and /3 = —0.8,-0.5,0,0.5,0.8. We investigate the 
following quantities: Firstly, size and power of the test which rejects Hq if the monitoring 
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procedure gives a signal. Second, the average run length (ARL) defined as E{Rn) and 
E{Rn), respectively, i.e., the average number of observations until we get a signal. Addi- 
tionally, we provide the conditional ARL given that the procedure gives a signal (CARL) 
defined as, e.g., E{Ri\i\Rn < N). That quantity informs us how fast the procedure reacts if 
it reacts at all. We use a maximum sample size of = 250. The bandwidth was chosen as 
h = 50. Simulated asymptotic critical values were used with ( = N/h = 5 to attain a nomi- 
nal rejection probability of 5%. The Gaussian and Epanechnikov kernels were investigated, 
which attach smaller weights to past summands than to more current ones. We found by 
simulations not reported here that the start of monitoring, k, should be proportional to h, 
and k = 1.5h yields a reasonable rule of thumb for ( = 5. 

Table [1] presents our results for the proposed procedure Rn to detect stationarity, using 
the Epanechnikov kernel for weighting. Here Hq : J(l)-unit root is given by = 1. The 
results are generally supportive of the theory developed in the paper. We do not report the 
results for the Gaussian kernel, since they were quite similar. The first three rows present 
the actual sizes for different values of /3. It can be seen that there is only a slight size 
distortion, similar as for the KPSS fixed-sample test. The remaining rows provide power 
estimates, CARLs, and ARLs. Overall, it appears that the monitoring approach provides 
a powerful method to detect quickly stationarity, as can be seen from the CARL values in 
parentheses. In many cases stationarity can be detected very early and it is not necessary 
to wait until the time horizon A^. 

We next consider the properties of the procedure Rn to detect a unit root. Here Hq : 
/(O)-stationarity corresponds to |0| < 1 in our simulation model. For the Newey-West 
estimator we have to choose the lag truncation parameter m. We considered the fol- 
lowing choices of m as a function of the (current) sample size: m3 = [0.75?t,^/^ + 0.5J , 
m4 = [4(n/100)^/^ + 0.5j, and ml2 = [12(n/100)^/^ + 0.5J with n = [Nk\, . . . , Rn < N 
denoting the time point where the estimator has to be calculated. The rules m4 and ml2 
have also been used by Kwiatkowski et al. (1992), for m3 see Stock and Watson (2003, eq. 
13.17). For = and f3 = —0.8, —0.5,0,0.5 we simulated the type I error for all choices 
of m. As can be seen from the top rows of Tabled the difference seems negligible. For the 
remaining cases given by = 0.2, 0.6, 0.9, 1 we used m4. The last three rows of the table 
provide the performance to detect the unit root given by = 1. Overall, the empirical 
rejection rates and ARL/CARL values indicate that for moderate positive autocorrelation 
(0 < < 0.6) the procedure has moderate size distortion. But, as expected, for close to 
1 the procedure overreacts. The power is uniformly high for all values of (3 studied here. 

22 



4.2. Change-point models. We also investigated the performance of the detection meth- 
ods Rn and -R^v in change-point models. Of particular interest is to study the influence of 
the bandwidth h on the performance. To evaluate the rule (detection of stationarity), 
we used the following specification of the change-point model given in the introduction, 



with = 250. {et} are i.i.d. A^(0, l)-innovations. The change-point parameter is chosen 
as ?9 = 0.1, 0.5, 0.75, and the bandwidth as h = 125, 50, 25. 

Table m reports power, the average delay, defined as Emax^R^ — [N{}\,0), and the condi- 
tional average delay given the method provides a signal, defined as E{Ri\f\R]\f < N) — [N'dl , 
which informs us how quickly the procedure reacts if it reacts at all. It can be seen that 
there is only a negligible effect of the bandwidth h on the average delay, but a remarkable 
positive effect on the conditional average delay and the statistical power to reject the unit 
root hypothesis. Comparing h = 125 with h = 50 for i} = 0.1 and i) = 0.5 indicates that 
large bandwidths provide high overall power but the signal often comes late. To detect the 
change early smaller bandwidths seem to be better. Comparing with h = 10 shows that 
CARL increases again. It seems, that for the setting studied here values between 25 and 
50 provide reasonable results. 

To investigate the detection rule Rn (detection of a unit root), we used the same change- 
point model as above, but with 0„ = 0.6 if n < [A^-i^J and 0„ = 1 if n > [A^-i^J . This 
means, before the change the process is AR{1) with autoregressive parameter 0.6, and 
after the change we are given a pure random walk. The parameter was chosen as above 
and h = 125, 50, 25, 10. As can be seen from Table HI the detection performance is excellent 
in terms of power, average delay, and conditional average delay. Results for h = 5 were 
almost identical to = 10 and are therefore omitted. Overall, small bandwidths increase 
the power substantially and yield smaller delays. 

4.3. An example. Figure [1] illustrates the detection performance of the proposed proce- 
dure for a time series of length 250 which has a change-point. The first 100 observations 
follow an AR(1) with coefficient (p = 0.8. After the change-point given hj i) = 0.4, the 
series is a random walk {(p = 1). We applied the procedure Rn using the Epanechnikov 
kernel, bandwidth h = 25, the lag selection rule m4, and an asymptotic 5% control limit 
using ( = 10. The change is detected at obs. 167. 
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5. Software 



User-friendly and platform independent JAVA software implementing the proposed meth- 
ods, particularly providing asymptotic control limits, and example data sets can be down- 
loaded from the author's webpage. 

6. Conclusions 

Monitoring rules to detect quickly stationarity and unit roots based on a kernel-weighted 
process related to the KPSS statistics are studied. Limiting distributions under various dis- 
tributional assumptions including local-to-unity and change-point models are established. 
Simulations indicate that the procedures share the moderate size distortion of the KPSS 
test, but due to its weighting scheme controlled by a bandwidth parameter h the reaction 
performance is substantially improved. Both, changes from /(O) to /(I) and changes from 
/(I) to /(O) can be detected in many cases very early, if h is chosen appropriately. 
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Table 1. Detecting stationarity using with ( — 5: Empirical size respec- 
tively power, CARL given a signal (in parentheses), and ARL (in brackets) 
for various values of (AR parameter) and /3 (MA parameter). 
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Table 2. Detecting unit roots using with C = 5: Empirical size respec- 
tively power, CARL given a signal (in parentheses), and ARL (in brackets), 
for various values of (AR parameter) and /3 (MA parameter). 
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Table 4. Change from /(O) to /(I): Empirical rejection rates, conditional 
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Figure 1. A time scries with a change-point at obs. 100 where the AR 
coefficient changes from 0.8 to 1. The change is detected at obs. 161. 
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